A Map-Reduce-enabled SOLAP cube for large-scale remotely sensed data aggregation

نویسندگان

  • Jiyuan Li
  • Lingkui Meng
  • Frank Wang
  • Wen Zhang
  • Yang Cai
چکیده

Spatial On-Line Analytical Processing (SOLAP) is a powerful decision support systems tool for exploring the multidimensional perspective of spatial data. In recent years, remotely sensed data have been integrated into SOLAP cubes, and this improvement has advantages in spatio-temporal analysis for environment monitoring. However, the performance of aggregations in SOLAP still faces a considerable challenge from the large-scale dataset generated by Earth observation. From the perspective of data parallelism, a tile-based SOLAP cube model, the so-called Tile Cube, is presented in this paper. The novel model implements Roll-Up/Drill-Across operations in the SOLAP environment based on Map-Reduce, a popular data-intensive computing paradigm, and improves the throughput and scalability of raster aggregation. Therefore, the long time-series, wide-range and multi-view analysis of remotely sensed data can be processed in a short time. The Tile Cube prototype was built on Hadoop/Hbase, and drought monitoring is used as an example to illustrate the aggregations in the model. The performance testing indicated the model can be scaled along with both the data growth and node growth. It is applicable and natural to integrate the SOLAP cube with Map-Reduce. Factors that influence the performance are also discussed, and the balance of themwill be considered in future works to make full use of data locality for model optimisation. & 2014 Elsevier Ltd. All rights reserved.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Historical Remotely Sensed Sea Surface Temperature Data for Prediction of Coral Bleaching Event in Kish Island, the Persian Gulf

The capability of Degree Heating Weeks index (DHWs) was examined for prediction of bleaching events in the coral reef communities of the Kish Island located in the north of the Persian Gulf. In doing so, weekly Sea Surface Temperature (SST) values (in 1°×1° spatial resolution) prepared by National Oceanic and Atmospheric Administration (NOAA), coupled with documented bleaching events, such...

متن کامل

Spatiotemporal Estimation of PM2.5 Concentration Using Remotely Sensed Data, Machine Learning, and Optimization Algorithms

PM 2.5 (particles <2.5 μm in aerodynamic diameter) can be measured by ground station data in urban areas, but the number of these stations and their geographical coverage is limited. Therefore, these data are not adequate for calculating concentrations of Pm2.5 over a large urban area. This study aims to use Aerosol Optical Depth (AOD) satellite images and meteorological data from 2014 to 2017 ...

متن کامل

Spatiotemporal analysis of remotely sensed Landsat time series data for monitoring 32 years of urbanization

The world is witnessing a dramatic shift of settlement pattern from rural to urban population, particularly in developing countries. The rapid Addis Ababa urbanization reflects this global phenomenon and the subsequent socio-economic and environmental impacts, are causing massive public uproar and political instability. The objective of this study was to use remotely sensed Landsat data to iden...

متن کامل

Discovery of High Confidence Association Rules in Remotely Sensed Images

Spatial data mining of Remotely Sensed Images (RSI) has become an important field of research as extremely large amounts of data are being collected from remote sources such as the Landsat satellite Thematic Mapper (TM) and other remote imaging systems. Association Rule Mining (ARM) has become an important method for mining large amounts of data in many areas beyond its originally proposed mark...

متن کامل

A Comparative Study of SVM and RF Methods for Classification of Alteration Zones Using Remotely Sensed Data

Identification and mapping of the significant alterations are the main objectives of the exploration geochemical surveys. The field study is time-consuming and costly to produce the classified maps. Therefore, the processing of remotely sensed data, which provide timely and multi-band (multi-layer) data, can be substituted for the field study. In this study, the ASTER imagery is used for altera...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Computers & Geosciences

دوره 70  شماره 

صفحات  -

تاریخ انتشار 2014